Model Selection via Rate - Distortion Theory
نویسنده
چکیده
Rissanen’s Minimum Description Length (MDL) principle for model selection proposes that, among a predetermined collection of models, we choose the one which assigns the shortest description to the data at hand. In this context, a “description” is a lossless representation of the data that also takes into account the cost of describing the chosen model itself. We examine how the MDL principle might extend to the case when the requirement for lossless coding is relaxed (lossy compression), and we outline some of the mathematical and conceptual ingredients that facilitate this extension
منابع مشابه
Simultaneous model selection via rate-distortion theory, with applications to cluster and significance analysis of gene expression data
High-dimensional data are prevalent across many application areas, and generate an everincreasing demand for statistical methods of dimension reduction, such as cluster and significance analysis. One application area that has recently received much interest is the analysis of microarray gene expression data. The results of cluster analysis are open to subjective interpretation. To facilitate th...
متن کاملRadial Distortion Snakes
In this paper, we address the problem of recovering the camera radial distortion coefficients from one image. The approach that we propose uses a special kind of snakes called radial distortion snakes. Radial distortion snakes behave like conventional deformable contours, except that their behavior are globally connected via a consistent model of image radial distortion. Experiments show that r...
متن کاملRate-Distortion Bounds for Wyner-Ziv Coding With Gaussian Scale Mixture Correlation Noise
The objective of this work is the characterization of the Wyner-Ziv rate-distortion function for memoryless continuous sources, when the correlation between the sources is modeled via an additive noise channel. Modeling the distribution of the correlation noise via a Gaussian mixture, with discrete or continuous mixing variable, provides a unified signal model able to describe a wide class of d...
متن کاملWavelet thresholding via MDL for natural images
We study the application of Rissanen's Principle of Minimum Description Length (MDL) to the problem of wavelet denoising and compression for natural images. After making a connection between thresholding and model selection, we derive an MDL criterion based on a Laplacian model for noiseless wavelet coe cients. We nd that this approach leads to an adaptive thresholding rule. While achieving mea...
متن کاملRate-Distortion Analysis of Pose Estimation via Multi-Aspect Scattering Data
A Hidden Markov Model (HMM) provides an efficient means of modeling multiaspect scattering data, with each HMM state representing a contiguous set of target-sensor orientations over which the wave physics is approximately stationary. The HMM-estimated state sequence gives a good approximation of the target pose. Rate-distortion theory is used to develop an error bound for estimating the state s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000